SherbyNet - /page/wikibook/entry.mu

Micron Document

<!DOCTYPE html>

<title>Reference class problem</title>

</head>

Reference class problem

</h1>

</header>

In <a href="Statistics" title="Statistics">statistics</a>, the reference class problem is the problem of deciding what class to use when calculating the <a href="Probability" title="Probability">probability</a> applicable to a particular case.

For example, to estimate the probability of an aircraft crashing, we could refer to the frequency of crashes among various different sets of aircraft: all aircraft, this make of aircraft, aircraft flown by this company in the last ten years, etc. In this example, the aircraft for which we wish to calculate the probability of a crash is a member of many different classes, in which the frequency of crashes differs. It is not obvious which class we should refer to for this aircraft. In general, any case is a member of very many classes among which the frequency of the attribute of interest differs. The reference class problem discusses which class is the most appropriate to use.

More formally, many arguments in statistics take the form of a <a href="Statistical_syllogism" title="Statistical syllogism">statistical syllogism</a>:

</mstyle>

</mrow>

<annotation encoding="application/x-tex">{\displaystyle X}</annotation>

</semantics>

</math><img src="./68baa052181f707c662844a465bfeeb135e82bab.svg" class="mwe-math-fallback-image-inline mw-invert skin-invert" aria-hidden="true" style="vertical-align: -0.338ex; width:1.98ex; height:2.176ex;" alt="{\displaystyle X}" loading="lazy"> proportion of <math xmlns="http://www.w3.org/1998/Math/MathML" alttext="{\displaystyle F}">

</mstyle>

</mrow>

<annotation encoding="application/x-tex">{\displaystyle F}</annotation>

</semantics>

</math><img src="./545fd099af8541605f7ee55f08225526be88ce57.svg" class="mwe-math-fallback-image-inline mw-invert skin-invert" aria-hidden="true" style="vertical-align: -0.338ex; width:1.741ex; height:2.176ex;" alt="{\displaystyle F}" loading="lazy"> are <math xmlns="http://www.w3.org/1998/Math/MathML" alttext="{\displaystyle G}">

</mstyle>

</mrow>

<annotation encoding="application/x-tex">{\displaystyle G}</annotation>

</semantics>

</mstyle>

</mrow>

<annotation encoding="application/x-tex">{\displaystyle I}</annotation>

</semantics>

</math><img src="./535ea7fc4134a31cbe2251d9d3511374bc41be9f.svg" class="mwe-math-fallback-image-inline mw-invert skin-invert" aria-hidden="true" style="vertical-align: -0.338ex; width:1.172ex; height:2.176ex;" alt="{\displaystyle I}" loading="lazy"> is an <math xmlns="http://www.w3.org/1998/Math/MathML" alttext="{\displaystyle F}">

</mstyle>

</mrow>

<annotation encoding="application/x-tex">{\displaystyle F}</annotation>

</semantics>

<li>Therefore, the chance that <math xmlns="http://www.w3.org/1998/Math/MathML" alttext="{\displaystyle I}">

</mstyle>

</mrow>

<annotation encoding="application/x-tex">{\displaystyle I}</annotation>

</semantics>

</math><img src="./535ea7fc4134a31cbe2251d9d3511374bc41be9f.svg" class="mwe-math-fallback-image-inline mw-invert skin-invert" aria-hidden="true" style="vertical-align: -0.338ex; width:1.172ex; height:2.176ex;" alt="{\displaystyle I}" loading="lazy"> is a <math xmlns="http://www.w3.org/1998/Math/MathML" alttext="{\displaystyle G}">

</mstyle>

</mrow>

<annotation encoding="application/x-tex">{\displaystyle G}</annotation>

</semantics>

</math><img src="./f5f3c8921a3b352de45446a6789b104458c9f90b.svg" class="mwe-math-fallback-image-inline mw-invert skin-invert" aria-hidden="true" style="vertical-align: -0.338ex; width:1.827ex; height:2.176ex;" alt="{\displaystyle G}" loading="lazy"> is <math xmlns="http://www.w3.org/1998/Math/MathML" alttext="{\displaystyle X}">

</mstyle>

</mrow>

<annotation encoding="application/x-tex">{\displaystyle X}</annotation>

</semantics>

</mstyle>

</mrow>

<annotation encoding="application/x-tex">{\displaystyle F}</annotation>

</semantics>

</math><img src="./545fd099af8541605f7ee55f08225526be88ce57.svg" class="mwe-math-fallback-image-inline mw-invert skin-invert" aria-hidden="true" style="vertical-align: -0.338ex; width:1.741ex; height:2.176ex;" alt="{\displaystyle F}" loading="lazy"> is called the "reference class" and <math xmlns="http://www.w3.org/1998/Math/MathML" alttext="{\displaystyle G}">

</mstyle>

</mrow>

<annotation encoding="application/x-tex">{\displaystyle G}</annotation>

</semantics>

</math><img src="./f5f3c8921a3b352de45446a6789b104458c9f90b.svg" class="mwe-math-fallback-image-inline mw-invert skin-invert" aria-hidden="true" style="vertical-align: -0.338ex; width:1.827ex; height:2.176ex;" alt="{\displaystyle G}" loading="lazy"> is the "attribute class" and <math xmlns="http://www.w3.org/1998/Math/MathML" alttext="{\displaystyle I}">

</mstyle>

</mrow>

<annotation encoding="application/x-tex">{\displaystyle I}</annotation>

</semantics>

</math><img src="./535ea7fc4134a31cbe2251d9d3511374bc41be9f.svg" class="mwe-math-fallback-image-inline mw-invert skin-invert" aria-hidden="true" style="vertical-align: -0.338ex; width:1.172ex; height:2.176ex;" alt="{\displaystyle I}" loading="lazy"> is the individual object. How is one to choose an appropriate class <math xmlns="http://www.w3.org/1998/Math/MathML" alttext="{\displaystyle F}">

</mstyle>

</mrow>

<annotation encoding="application/x-tex">{\displaystyle F}</annotation>

</semantics>

In <a href="Bayesian_statistics" title="Bayesian statistics">Bayesian statistics</a>, the problem arises as that of deciding on a <a href="Prior_probability" title="Prior probability">prior probability</a> for the outcome in question (or when considering multiple outcomes, a prior probability distribution).

<div class="mw-heading mw-heading2"><h2 id="History">History</h2></div>

<a href="John_Venn" title="John Venn">John Venn</a> stated in 1876 that "every single thing or event has an indefinite number of properties or attributes observable in it, and might therefore be considered as belonging to an indefinite number of different classes of things", leading to problems with how to assign probabilities to a single case. He used as an example the probability that John Smith, a consumptive Englishman aged fifty, will live to sixty-one.<a href="#cite_note-1">[1]</a>

The name "problem of the reference class" was given by <a href="Hans_Reichenbach" title="Hans Reichenbach">Hans Reichenbach</a>, who wrote, "If we are asked to find the probability holding for an individual future event, we must first incorporate the event into a suitable reference class. An individual thing or event may be incorporated in many reference classes, from which different probabilities will result."<a href="#cite_note-2">[2]</a>

There has also been discussion of the reference class problem in philosophy<a href="#cite_note-3">[3]</a> and in the <a href="Life_science" class="mw-redirect" title="Life science">life sciences</a>, e.g., clinical trial prediction.<a href="#cite_note-4">[4]</a>

In the book <a href="Anthropic_Bias" title="Anthropic Bias">Anthropic Bias</a>, <a href="Philosophy" title="Philosophy">philosopher</a> <a href="Nick_Bostrom" title="Nick Bostrom">Nick Bostrom</a> described ways in which reference classes can be applied to reasoning about one's position in reality. Bostrom investigates how to reason when one suspects that <a href="Evidence" title="Evidence">evidence</a> is biased by "observation selection effects", in other words, when the evidence presented has been pre-filtered by the condition that there was some appropriately positioned observer to "receive" the evidence.<a href="#cite_note-5">[5]</a><a href="#cite_note-:0-6">[6]</a> This conundrum is sometimes called the "<a href="Anthropic_principle" title="Anthropic principle">anthropic principle</a>", "self-locating belief", or "<a href="Indexicality" title="Indexicality">indexical</a> information". The book first discusses the <a href="Fine-tuned_universe" title="Fine-tuned universe">fine-tuned universe</a> hypothesis and its possible explanations, notably considering the possibility of a <a href="Multiverse" title="Multiverse">multiverse</a>.

Bostrom argues against the self-indication assumption (SIA), a term he uses to characterize some existing views, and introduces the self-sampling assumption (SSA): that you should think of yourself as if you were a random observer from a suitable reference class. He later refines SSA into using observer-moments instead of observers to address certain paradoxes in anthropic reasoning, formalized as the strong self-sampling assumption (SSSA): Each observer-moment should reason as if it were randomly selected from the class of all observer-moments in its reference class.<a href="#cite_note-7">[7]</a> These different assumptions are affected differently based on the choice of reference class. An application of the principle underlying SSSA (though this application is nowhere expressly articulated by Bostrom), is: If the minute in which you read this article is randomly selected from every minute in every human's lifespan, then (with 95% confidence) this event has occurred after the first 5% of human observer-moments. If the mean lifespan in the future is twice the historic mean lifespan, this implies 95% confidence that N < 10n (the average future human will account for twice the observer-moments of the average historic human). Therefore, the 95th percentile extinction-time estimate in this version is 4560 years.

<div class="mw-heading mw-heading2"><h2 id="Legal_applications">Legal applications</h2></div>

Applying <a href="Bayesian_probability" title="Bayesian probability">Bayesian probability</a> in practice involves assessing a <a href="Prior_probability" title="Prior probability">prior probability</a> which is then applied to a <a href="Likelihood_function" title="Likelihood function">likelihood function</a> and updated through the use of <a href="Bayes'_theorem" title="Bayes' theorem">Bayes' theorem</a>. Suppose we wish to assess the probability of guilt of a defendant in a court case in which DNA (or other probabilistic) evidence is available. We first need to assess the prior probability of guilt of the defendant. We could say that the crime occurred in a city of 1,000,000 people, of whom 15% meet the requirements of being the same sex, age group and approximate description as the perpetrator. That suggests a prior probability of guilt of 1 in 150,000. We could cast the net wider and say that there is, say, a 25% chance that the perpetrator is from out of town, but still from this country, and construct a different prior estimate. We could say that the perpetrator could come from anywhere in the world, and so on.

Legal theorists have discussed the reference class problem particularly with reference to the Shonubi case. Charles Shonubi, a Nigerian drug smuggler, was arrested at <a href="JFK_Airport" class="mw-redirect" title="JFK Airport">JFK Airport</a> on Dec 10, 1991, and convicted of <a href="Heroin" title="Heroin">heroin</a> importation. The severity of his sentence depended not only on the amount of drugs on that trip, but the total amount of drugs he was estimated to have imported on seven previous occasions on which he was not caught. Five separate legal cases debated how that amount should be estimated. In one case, "Shonubi III", the prosecution presented statistical evidence of the amount of drugs found on Nigerian drug smugglers caught at JFK Airport in the period between Shonubi's first and last trips. There has been debate over whether that is the (or a) correct reference class to use, and if so, why.<a href="#cite_note-8">[8]</a><a href="#cite_note-9">[9]</a>

Other legal applications involve valuation. For example, houses might be valued using the data in a database of house sales of "similar" houses. To decide on which houses are similar to a given one, one needs to know which features of a house are relevant to price. Number of bathrooms might be relevant, but not the eye color of the owner. It has been argued that such reference class problems can be solved by finding which features are relevant: a feature is relevant to house price if house price <a href="Covariance" title="Covariance">covaries</a> with it (it affects the likelihood that the house has a higher or lower value), and the ideal reference class for an individual is the set of all instances which share with it all relevant features.<a href="#cite_note-10">[10]</a><a href="#cite_note-11">[11]</a>

<ul><li><a href="Statistical_syllogism" title="Statistical syllogism">Statistical syllogism</a></li>

<li><a href="Reference_class_forecasting" title="Reference class forecasting">Reference class forecasting</a></li>

<li><a href="Spectrum_bias" title="Spectrum bias">Spectrum bias</a></li>

<li><a href="Simpson's_paradox" title="Simpson's paradox">Simpson's paradox</a></li></ul>

<div class="mw-heading mw-heading2"><h2 id="References">References</h2></div>

/* start https://en.wikipedia.org/ */

.mw-parser-output .reflist{margin-bottom:0.5em;list-style-type:decimal}@media screen{.mw-parser-output .reflist{font-size:90%}}.mw-parser-output .reflist .references{font-size:100%;margin-bottom:0;list-style-type:inherit}.mw-parser-output .reflist-columns-2{column-width:30em}.mw-parser-output .reflist-columns-3{column-width:25em}.mw-parser-output .reflist-columns{margin-top:0.3em}.mw-parser-output .reflist-columns ol{margin-top:0}.mw-parser-output .reflist-columns li{page-break-inside:avoid;break-inside:avoid-column}.mw-parser-output .reflist-upper-alpha{list-style-type:upper-alpha}.mw-parser-output .reflist-upper-roman{list-style-type:upper-roman}.mw-parser-output .reflist-lower-alpha{list-style-type:lower-alpha}.mw-parser-output .reflist-lower-greek{list-style-type:lower-greek}.mw-parser-output .reflist-lower-roman{list-style-type:lower-roman}

/* end https://en.wikipedia.org/ */

</style><div class="reflist">

<li id="cite_note-1"><a href="#cite_ref-1">^</a> J. Venn,The Logic of Chance (2nd ed, 1876), p. 194.

</li>

<li id="cite_note-2"><a href="#cite_ref-2">^</a> H. Reichenbach, The Theory of Probability (1949), p. 374

</li>

<li id="cite_note-3"><a href="#cite_ref-3">^</a> A. Hájek, <a rel="nofollow" class="external text" href="https://web.archive.org/web/20180111165141/https://pdfs.semanticscholar.org/2899/90fa6af58b0e1b3103fdee05aef57e53de48.pdf">The Reference Class Problem is Your Problem Too</a>, Synthese 156 (2007): 185-215.

</li>

/* start https://en.wikipedia.org/ */

.mw-parser-output cite.citation{font-style:inherit;word-wrap:break-word}.mw-parser-output .citation q{quotes:"\"""\"""'""'"}.mw-parser-output .citation:target{background-color:rgba(0,127,255,0.133)}.mw-parser-output .id-lock-free.id-lock-free a{background:url("./mw/Lock-green.svg")right 0.1em center/9px no-repeat}.mw-parser-output .id-lock-limited.id-lock-limited a,.mw-parser-output .id-lock-registration.id-lock-registration a{background:url("./mw/Lock-gray-alt-2.svg")right 0.1em center/9px no-repeat}.mw-parser-output .id-lock-subscription.id-lock-subscription a{background:url("./mw/Lock-red-alt-2.svg")right 0.1em center/9px no-repeat}.mw-parser-output .cs1-ws-icon a{background:url("./mw/Wikisource-logo.svg")right 0.1em center/12px no-repeat}body:not(.skin-timeless):not(.skin-minerva) .mw-parser-output .id-lock-free a,body:not(.skin-timeless):not(.skin-minerva) .mw-parser-output .id-lock-limited a,body:not(.skin-timeless):not(.skin-minerva) .mw-parser-output .id-lock-registration a,body:not(.skin-timeless):not(.skin-minerva) .mw-parser-output .id-lock-subscription a,body:not(.skin-timeless):not(.skin-minerva) .mw-parser-output .cs1-ws-icon a{background-size:contain;padding:0 1em 0 0}.mw-parser-output .cs1-code{color:inherit;background:inherit;border:none;padding:inherit}.mw-parser-output .cs1-hidden-error{display:none;color:var(--color-error,#d33)}.mw-parser-output .cs1-visible-error{color:var(--color-error,#d33)}.mw-parser-output .cs1-maint{display:none;color:#085;margin-left:0.3em}.mw-parser-output .cs1-kern-left{padding-left:0.2em}.mw-parser-output .cs1-kern-right{padding-right:0.2em}.mw-parser-output .citation .mw-selflink{font-weight:inherit}@media screen{.mw-parser-output .cs1-format{font-size:95%}html.skin-theme-clientpref-night .mw-parser-output .cs1-maint{color:#18911f}}@media screen and (prefers-color-scheme:dark){html.skin-theme-clientpref-os .mw-parser-output .cs1-maint{color:#18911f}}

/* end https://en.wikipedia.org/ */

</style><cite id="CITEREFAtanasovJosephFeijooMarshall2021" class="citation journal cs1">Atanasov, Pavel D.; Joseph, Regina; Feijoo, Felipe; Marshall, Max; Siddiqui, Sauleh (2021-12-09). <a rel="nofollow" class="external text" href="https://papers.ssrn.com/abstract=3981732">"Human Forest vs. Random Forest in Time-Sensitive COVID-19 Clinical Trial Prediction"</a>. SSRN Electronic Journal. Rochester, NY. <a href="SSRN_(identifier)" class="mw-redirect" title="SSRN (identifier)">SSRN</a> <a rel="nofollow" class="external text" href="https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3981732">3981732</a>.</cite>

</li>

<li id="cite_note-5"><a href="#cite_ref-5">^</a> <cite class="citation web cs1"><a rel="nofollow" class="external text" href="http://www.anthropic-principle.com/?q=anthropic_bias">"Anthropic Bias | anthropic-principle.com"</a>. www.anthropic-principle.com. Retrieved 2015-11-03.</cite>

</li>

<li id="cite_note-:0-6"><a href="#cite_ref-:0_6-0">^</a> <cite id="CITEREFBostrom2002" class="citation book cs1">Bostrom, Nick (2002). Anthropic bias: observation selection effects in science and philosophy. Studies in philosophy. New York: Routledge. <a href="ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <bdi>978-0-415-88394-8</bdi>.</cite>

</li>

<li id="cite_note-7"><a href="#cite_ref-7">^</a> <cite id="CITEREFBostrom2005" class="citation web cs1">Bostrom, Nick (2005). <a rel="nofollow" class="external text" href="https://anthropic-principle.com/preprints/self-location">"Self-Location and Observation Selection Theory"</a>. anthropic-principle.com. Retrieved 2023-07-02.</cite>

</li>

<li id="cite_note-8"><a href="#cite_ref-8">^</a> M. Colyvan, H.M. Regan and S. Ferson, <a rel="nofollow" class="external text" href="http://colyvan.com/papers/shonubi.pdf">Is it a crime to belong to a reference class?</a>, Journal of Political Philosophy 9 (2001): 168-181

</li>

<li id="cite_note-9"><a href="#cite_ref-9">^</a> <cite id="CITEREFTillers2005" class="citation journal cs1"><a href="Peter_Tillers" title="Peter Tillers">Tillers, Peter</a> (2005). <a rel="nofollow" class="external text" href="https://academic.oup.com/lpr/article/4/1-2/33/916215?login=true">"If wishes were horses: discursive comments on attempts to prevent individuals from being unfairly burdened by their reference classes"</a>. Law, Probability and Risk. 4 (1–2): 33–49. <a href="Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<a rel="nofollow" class="external text" href="https://doi.org/10.1093%2Flpr%2Fmgi001">10.1093/lpr/mgi001</a>.</cite>

</li>

<li id="cite_note-10"><a href="#cite_ref-10">^</a> <cite id="CITEREFFranklin2010" class="citation journal cs1"><a href="James_Franklin_(philosopher)" title="James Franklin (philosopher)">Franklin, James</a> (Mar 2010). <a rel="nofollow" class="external text" href="https://philpapers.org/archive/FRAFSM.pdf">"Feature selection methods for solving the reference class problem"</a> (PDF). Columbia Law Review Sidebar. 110. Retrieved 30 June 2021.</cite>

</li>

<li id="cite_note-11"><a href="#cite_ref-11">^</a> <cite id="CITEREFFranklin2011" class="citation journal cs1">Franklin, James (2011). <a rel="nofollow" class="external text" href="http://www8.austlii.edu.au/cgi-bin/viewdoc/au/journals/SydLawRw/2011/23.html">"The objective Bayesian conceptualisation of proof and reference class problems"</a>. Sydney Law Review. 33: 545–561. Retrieved 30 June 2021.</cite>

</li>

</ol></div></div></div><div><div class="zim-footer">

This article is issued from <a class="external text" title="Last edited on 2025-06-18" href="https://en.wikipedia.org/wiki/?title=Reference_class_problem&oldid=1296161508">Wikipedia</a>. The text is available under <a class="external text" href="https://creativecommons.org/licenses/by-sa/4.0/deed.en">Creative Commons Attribution-Share Alike 4.0</a> unless otherwise noted. Additional terms may apply for the media files.

</div>

</div></div>

</div>

</main>

</div>

</body></html>